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SECTION  1.  GENERAL 


1,1  Purpose. 

^  This  Test  Plan  for  the  microcomputer-based  Local  Automation  Model  (microLAM)  is  written 
to: 


'  Establish  a  comprehensive  test  plan  to  determine  whether  the  prototype  system  provides 
the  functions  and  capabilities  required  for  the  microLAM^ 

1  2)  Describe  the  procedures  and  methods  for  testing  the  prototype  system  ^ 

-  •  '  Provide  a  record  of  the  evaluation  criteria  used  for  assessing  prototype  system  performance  ^ 


.  •  '^  Assist  in  the  development  of  microLAM  functional  specifications  for  use  in  acquiring  the 
microLAM  production  system.  ' 

>  *  •  >//  *  t  i  ■ '  J 

,  . .  ■  '  ^  -  ■  / 

1.2  Project  Description  and  References.  ^  .  ^  /j  ^  r"  /n  //  ,  . 


/ 

The  microLAM  encompasses  a  system  design,  development,  and  evaluation  project  sponsored 
by  the  Defense  Technical  Information  Center  (OTIC)  located  at  Cameron  Station,  Alexandria, 
Virginia.  The  requirements  for  the  system  are  documented  in  Microcomputer-Based  Local 
Automation  Model:  Functional  Description.  Logistics  Management  Institute,  October  1985. 

The  prototype  system  -  planned  for  implementation  at  the  U.S.  Army  Training  and  Doctrine 
Command  (TRADOC)  Technical  Library  at  Fort  Monroe,  Virginia  — will  provide  the  opportunity  to 


demonstrate  and  evaluate  an  automated  library  system  with  special  features  for  bibliographic 
information  sharing.  The  system  will  support  conventional  collection-handling  capabilities  such  as 
original  cataloging  and  citation  retrieval,  and  in  addition,  it  will  facilitate  information  sharing 
between  Department  of  Defense  (DoD)  technical  libraries  and  DTIC  by  incorporating  intelligent 
gateway  processing  capabilities. 

Gateway  capabilities  required  for  the  system  include  automatic  searching  of  both  the  local 
technical  library  catalog  and  the  DTIC  Technical  Reports  (TR)  data  base  using  a  single  search 
language  and  format,  downloading  of  information  from  the  TR  data  base  to  the  local  system,  and 
machine-aided  translation  of  locally  created  catalog  citations  into  a  format  acceptable  for  entry  in  the 
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TR  data  base.  Thus,  with  one  system  and  one  set  of  commands,  a  technical  library  can  maintain  and 
expand  a  catalog  tailored  to  its  needs,  access  the  information  contained  in  the  TR  data  base,  and 
contribute  directly  to  the  timely  dissemination  of  scientiflc  and  technical  information  via  direct 
cataloging  in  the  TR  data  base. 

The  prototype  and  production  systems  will  be  implemented  using  commercially  available 
library  software.  The  gateway  features  available  in  the  prototype  system  will  be  provided  through 
adaptation  of  a  subset  of  the  Integrated  Information  System  (IIS)  developed  by  the  Technology 
Information  System  group  at  Lawrence  Livermore  National  Laboratory.  The  commercial  library 
package  chosen  for  the  prototype  system  is  the  Unicorn  Collection  Management  System  developed  by 
Sirsi  Corporation. 

1.3  Terms  and  Abbreviations. 

The  following  terms,  acronyms,  and  abbreviations  are  used  in  this  document: 

•  DROLS:  Defense  ROT&E  On-Line  System 

•  DTIC:  Defense  Technical  Information  Center 

•  nS:  Integrated  Information  System -an  intelligent  gateway  developed  and  supported  by 
the  Technology  Information  System  group  at  Lawrence  Livermore  National  Laboratory 

•  LAM:  Local  Automation  Model  —  a  project  sponsored  by  the  Defense  Technical  Information 
System  for  demonstrating,  evaluating,  and  acquiring  an  integrated  library  system 
encompassing  local  collection  management,  and  access  to  external  bibliographic  resources 

•  LLNL:  Lawrence  Livermore  National  Laboratory  — a  Department  of  Energy-funded, 
contractor-operated  research  and  development  laboratory  located  in  Livermore,  California 

•  LMI:  Logistics  Management  Institute  —  the  microLAM  system  developer 

•  TIS:  Technology  Information  System  — used  to  describe  both  the  work  on  advanced 
information-handling  technology  and  the  organizational  element  performing  this  work  at 
LLNL 

•  TRAD(3C:  U.S.  Army  Training  and  Doctrine  Command,  the  command  at  which  the 
prototype  system  will  be  implemented 

•  TRALINET:  TRADOC  Library  Network,  comprised  of  TRADOC  technical  libraries  and 
managed  by  TRADOC  personnel  at  Ft.  Monroe,  Virginia 

•  TR  Data  Base:  The  Technical  Reports  data  base  operated  and  maintained  by  DTIC 
containing  more  than  1  million  citations  to  reports  published  or  sponsored  by  DoD. 


SECTION  2.  TEST  BACKGROUND  AND  PREPARATION 


2.1  Background. 

The  application  software  for  the  microLAM  consists  of  two  major  components:  (Da  commercial 
library  software  package  supporting  local  collection  cataloging,  retrieval,  and  circulation  manage¬ 
ment  and  control  and  (2)  an  intelligent  gateway  providing  access  to  the  DTIC  TR  data  base  for 
cataloging  and  retrieval.  The  gateway  also  provides  post-processing  capabilities  such  as  transferring 
TR  database  citations  to  the  local  system,  translating  and  merging  citations  from  both  sources  into  a 
common  format,  eliminating  duplicate  or  unwanted  citations,  and  citation  sorting. 

The  test  procedures  described  in  this  document  are  designed  for  testing  the  prototype  system. 
The  objective  of  the  test  is  to  determine  whether  the  LAM  concept,  i.e.  the  interoperability  of  library 
software  with  gateway  software  to  provide  simultaneous  access  to  two  or  more  heterogenous  data 
bases,  is  feasible.  The  results  of  the  test  will  be  used  in  the  development  of  functional  specifications 
for  acquisition  of  the  microLAM  production  system. 

After  the  Unicorn  package  has  been  installed  at  the  prototype  site,  integration  of  Unicorn  with 
the  gateway  software  will  proceed.  Requirements  for  the  integration  are  specified  in  Local 
Automation  Model:  Program  Specification  — User  Access  for  Cataloging  and  Retrieval.  Logistics 
Management  Institute,  September  1985.  When  the  integration  is  complete,  the  fully  integrated 
system  will  be  installed. 

2.2  Pretest  Activity. 

In  preparation  for  the  testing,  two  activities  must  be  completed:  software  and  hardware  acqui¬ 
sition  and  installation,  and  catalog  development. 

Software  and  Hardware  Acquisition  and  Installation.  The  system  developer  (LMI)  has  made 
arrangements  with  Sirsi  Corporation  and  Lawrence  Livermore  National  Laboratory  for  acquiring  the 
software  and  hardware  required  for  the  prototype  system.  The  hardware  and  the  commercial 
software  package  will  be  installed  at  the  TRADOC  Technical  Library  at  Ft.  Monroe  in  January  1986. 


The  integrated  software  (commercial  package  merged  with  the  gateway  software)  will  be  installed  in 
the  spring  of  1986. 

Catalog  Development.  A  catalog  of  TRADOC  library  holdings  will  be  developed  from  existing 
bibliographic  citations:  technical  report  citations  from  the  DTIC  TR  data  base  and  book  citations 
from  OCLC,  Inc.  Both  sets  of  citations  will  be  copied  to  magnetic  tape,  reformatted  for  use  in  the 
microLAM  catalog,  and  loaded  into  the  prototype  system  by  TRADOC  Library  Network  (TRALINET) 
Center  and  Sirsi  personnel. 

2.3  Test  Schedule. 

Testing  will  take  place  at  two  locations:  the  TRADOC  Technical  Library  and  the  TRALINET 
Center,  both  at  Ft.  Monroe,  Virginia.  The  system  configuration  includes  two  workstations  in  the 
library  and  one  in  the  TRALINET  Center  for  system  use;  each  of  the  workstations  can  be  used  for 
normal  library  operations  as  well  as  for  system  testing.  The  system  test  can  commence  when  the  test 
participants  have  been  trained  and  gained  experience  on  the  system.  The  system  test  will  end  no 
later  than  May  15, 1986. 

2.4  Personnel. 

As  primary  users  of  the  system,  the  TRADOC  Technical  Library  staff  and  TRALINET  Center 
staff  are  the  key  test  participants.  TRADOC  is  encouraged  to  provide  as  many  staff  members  as 
possible  from  the  two  organizations  to  participate  in  the  test. 

Staff  members  from  DTIC  are  invited  to  provide  assessments  of  software  performance,  func¬ 
tionality,  and  technical  suitability. 

Test  participants  may  perform  their  evaluations  independently  of  each  other,  consistent  with 
existing  assignments  and  job  responsibilities. 

Staff  members  from  LMI  will  be  responsible  for  compiling  and  summarizing  the  results  and 
evaluating  selected  features.  Test  results  will  be  coordinated  with  TRADOC  library  and  TRALINET 
staffs,  DTIC  participants,  and  project  members  from  Lawrence  Livermore  National  Laboratory. 

Recommendations  covering  organizational  responsibilities  for  testing  each  of  the  system 
functions  included  in  the  checklists  are  discussed  in  Section  3.2,  "Test  Description  ” 


SECTION  3.  TEST  SPECIFICATION  AND  DESCRIPTION 


3.1  Test  Specification. 

3.1.1  Requirements. 

Functions  and  processes  required  for  the  microLAM  system  have  been  documented  in  the 
microLAM  Functional  Description  cited  earlier.  These  requirements  are  reflected  in  the  checklists 
contained  in  Appendices  A  through  H,  which  serve  as  evaluation  forms  to  be  used  by  the  test 
participants  as  described  in  Section  3.2.  Separate  checklists  are  provided  for  each  major  system 
function  as  follows: 

•  Reference — Appendix  A 

•  Cataloging — Appendix  B 

•  Circulation  Management  and  Control  —  Appendix  C 

•  Reports  and  Other  Printed  Output  -  Appendix  D 

•  Security  and  Access  Control  -  Appendix  E 

•  Reliability  and  Maintainability  ~  Appendix  F 

•  Ease  of  U se  and  Modification  —  Appendix  G 

•  Hardware  and  Software  F eatures  —  Appendix  H . 

3.1.2  System  Functions. 

The  prototype  testing  will  focus  on  verifying  the  availability  of  functions  supporting  cata¬ 
loging,  retrieval,  and  circulation  management  and  control.  Although  the  production  system  may 
offer  additional  functions,  only  those  three  functions  were  identified  as  critical  by  potential  system 
users. 

More  than  300  features  are  included  for  evaluation,  and  while  some  may  not  appear  essential 
for  prototype  system  implementation,  they  have  all  been  included  to  make  the  test  as  comprehensive 
and  complete  as  possible.  To  aid  test  participants,  the  checklists  have  been  annotated  with  an  in 
the  left-hand  margin  for  essential  or  critical  features. 


Some  features  marked  with  an  may  appear  different  from  or  contradict  features  not  marked 
as  critical.  Such  apparent  contradictions  occur  because  the  checklists  allow  for  differences  in 
implementation  methods.  Where  alternative  implementation  methods  are  most  likely  to  be  used  to 
meet  requirements  for  critical  features,  the  alternative  methods  are  listed  for  evaluation. 

3.2  Test  Description. 

Each  of  the  checklists  in  Appendices  A  through  H  is  comprised  of  software  features  grouped 
into  categories.  Thus,  a  three-tiered  hierarchy  has  been  created;  functions  comprised  of  categories 
comprised  of  features.  The  Unicorn  package  will  be  tested  by  feature;  that  is,  test  participants  will 
conduct  the  test  by  determining  whether  the  package  offers  the  feature  on  the  checklist.  Examples  of 
features  are;  "System  provides  on-line  updating  of  catalog,”  "System  provides  global  search  and 
replace,”  "System  provides  record  locking  for  update  ” 

The  features  have  been  constructed  to  be  answered  in  a  "yes/no”  format  with  five  scoring  levels 
designed  to  differentiate  among  the  performance  levels.  This  scoring  will  allow  test  participants  to 
indicate  not  only  that  a  feature  is  or  is  not  available  but  also  that  a  feature  is  available  with  limi¬ 
tations.  The  scale  to  be  used  by  test  participants  in  rating  each  feature  is  as  follows; 

•  i  —  No,  the  system  does  not  offer  the  feature 

•  2-  Yes,  the  system  offers  the  feature  with  severe  limitations 

•  3  —  Yes,  the  system  offers  the  feature  with  moderate  limitations 

•  4  —  Yes,  the  system  offers  the  feature  with  minor  limitations 

•  5—  Yes,  the  system  offers  the  feature  without  limitations. 

To  complete  the  checklists,  a  test  participant  exercises  the  features  listed,  checks  the 
appropriate  score  column  (1,  2,  3,  4,  or  5),  and  adds  any  comments  in  the  column  provided  on  the 
checklist. 

To  minimize  the  time  required  by  any  participant,  we  recommend  that  primary  responsibility 
for  completing  the  checklists  be  assigned  as  follows. 

•  TRADOC  Technical  Library  Staff,  Ft  Monroe 


Appendix  A  -  Reference 


-  Appendix  B  -  Cataloging 

-  Appendix  C — Circulation  Management  and  Control 
Appendix  D  —  Reports  and  Other  Printed  Output 

•  TRALINET  Staff,  Ft.  Monroe 

-  Appendix  E  —  Security  and  Access  Control 

-  Appendix  F  -  Reliability  and  Maintainability 

-  Appendix  H  —  Hardware  and  Software  Features 

•  Shared  Responsibility  (Library  Staff  and  TRALINET  Staff) 

-  Appendix  G — Ease  of  U se  and  Modification. 

The  project  team  from  LMI  will  test  selected  system  features,  coordinate  the  test  activity,  and 
compile  the  test  results.  Members  of  the  DTIC  staff  are  invited  to  participate  in  the  testing. 

While  responsibilities  for  completing  each  of  the  checklists  are  assigned  to  specific  test 
participants,  all  participants  are  invited  to  prepare  and  submit  evaluations  on  any  or  all  of  the  eight 
functions. 

3.3  Test  Procedures. 

The  test  participants  will  initiate  and  run  all  tests  at  any  time  from  the  installation  of  the 
system  until  all  testing  is  completed  (not  later  than  May  15,  1986).  Neither  the  initiation  nor  the 
pace  of  the  testing  is  predetermined.  Control  of  the  testing  is  maintained  by  the  individual  test 
participant.  Before  beginning  the  formal  evaluation  of  any  function,  test  participants  are  encouraged 
to  read  the  user  manual  and  other  available  documentation  produced  by  Sirsi  and  Lawrence 
Livermore  National  Laboratory  on  the  use  of  the  software  packages. 

Each  test  is  initialized  by  logging-on  to  the  prototype  system.  To  perform  the  tests,  a 
participant  should  first  choose  the  function  to  be  evaluated.  Test  participants  are  encouraged  to  read 
through  each  checklist  completely  before  performing  any  evaluations.  Alter  choosing  the  function  to 
be  evaluated,  the  participants  should  evaluate  the  package  for  all  the  features  on  the  checklist  using 
the  live-point  scale  shown  in  Section  3.2.  As  stated  previously,  while  participants  are  required  to 


assign  a  numerical  score  for  each  feature,  they  are  also  encouraged  to  provide  written  comments 
whenever  possible  to  assist  in  the  overall  evaluation. 

The  evaluation  is  complete  when  the  participants  have  rated  each  feature  for  the  functions 
within  their  responsibility.  The  completed  checklists  should  be  sent  to  the  Logistics  Management 
Institute,  6400  Goldsboro  Road,  Bethesda,  Maryland  20817-5886,  Attention:  DL503  Project  Leader. 


APPENDIX  A 


TEST  PLAN  CHECKLIST;  REFERENCE 

This  appendix  contains  the  test  plan  checklist  for  the  "Reference”  function  and  features  of  the 
prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a  mark  in  the 
column  corresponding  to  the  score  you  feel  most  accurately  describes  the  feature.  Use  the  following 
scoring  scale  and  corresponding  criteria: 

1  -  No,  the  package  does  not  offer  the  feature 

2  -  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  -  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4-  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention;  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  also  be  mailed  to  that  address. 
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APPENDIX  B 


TEST  PLAN  CHECKLIST;  CATALOGING 

This  appendix  contains  the  test  plan  checklist  for  the  "Cataloging”  function  and  features  of  the 
prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a  mark  in  the 
column  corresponding  to  the  score  you  feel  most  accurately  describes  the  feature.  Use  the  following 
scoring  scale  and  corresponding  criteria: 

1  —  No,  the  package  does  not  offer  the  feature 

2  —  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4—  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention:  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886  Completed  checklists  should  also  be  mailed  to  that  address 
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APPENDIX  C 

TEST  PLAN  CHECKLIST;  CIRCULATION  MANAGEMENT  AND  CONTROL 

This  appendix  contains  the  test  plan  checklist  for  the  "Circulation  Management  and  Control” 
function  and  features  of  the  prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score 
by  placing  a  mark  in  the  column  corresponding  to  the  score  you  feel  most  accurately  describes  the 
feature.  Use  the  following  scoring  scale  and  corresponding  criteria; 

1  —  No,  the  package  does  not  offer  the  feature 

2  —  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4  —  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention;  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also. 
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APPENDIX  D 


TEST  PLAN  CHECKLIST:  REPORTS  AND  OTHER  PRINTED  OUTPUT 

This  appendix  contains  the  test  plan  checklist  for  "Reports  and  Other  Printed  Output”  features 
of  the  prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a  mark  in 
the  column  corresponding  to  the  score  you  feel  most  accurately  describes  the  feature.  Use  the  follow¬ 
ing  scoring  scale  and  corresponding  criteria: 

1  —  No,  the  package  does  not  offer  the  feature 

2  -  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4— Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention:  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also 
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APPENDIX  E 


TEST  PLAN  CHECKLIST.  SECURITY  AND  ACCESS  CONTROL 

This  appendix  contains  the  test  plan  checklist  for  "Security  and  Access  Control”  features  of  the 
prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a  mark  in  the 
column  corresponding  to  the  score  you  feet  most  accurately  describes  the  feature.  Use  the  following 
scoring  scale  and  corresponding  criteria. 

1  —  No,  the  package  does  not  offer  the  feature 

2  —  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4—  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention:  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also. 
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APPENDIX  F 


TEST  PLAN  CHECKLIST;  RELIABILITY  AND  MAINTAINABILITY 


This  appendix  contains  the  test  plan  checklist  covering  "Reliability  and  Maintainability” 
aspects  of  the  prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a 
mark  in  the  column  corresponding  to  the  score  you  feel  most  accurately  describes  the  feature.  Use  the 
following  scoring  scale  and  corresponding  criteria; 

1  —  No,  the  package  does  not  offer  the  feature 

2  —  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  — Yes,  the  package  offers  the  feature  with  moderate  limitations 

4  —  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  — Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 


Logistics  Management  Institute,  Attention;  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also. 
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TEST  PLAN  CHECKLIST;  EASE  OF  USE  AND  MODIFICATION 


This  appendix  contaii:  -  the  test  plan  checklist  for  assessing  the  "Ease  of  Use  and  Modification” 
features  of  the  prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by  placing  a 
mark  in  the  column  corresponding  to  the  score  you  feel  most  accurately  describes  the  feature.  Use  the 
following  scoring  scale  and  corresponding  criteria; 

1  —  No,  the  package  does  not  offer  the  feature 
2— Yes,  the  package  oHers  the  feature  but  with  severe  limitations 
3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 
4— Yes,  the  package  offers  the  feature  with  minor  limitations 
5  —  Yes,  the  package  offers  the  feature  without  limitations 

Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention;  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also. 
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APPENDIX  H 

TEST  PLAN  CHECKLIST;  HARDWARE  AND  SOFTWARE  FEATURES 


This  appendix  contains  the  test  plan  checklist  for  evaluating  the  "Hardware  and  Software” 
features  offered  by  the  prototype  system.  Check  only  one  score  per  feature.  Indicate  your  score  by 
placing  a  mark  in  the  column  corresponding  to  the  score  you  feel  most  accurately  describes  the 
feature.  Use  the  following  scoring  scale  and  corresponding  criteria; 


1  -  No,  the  package  does  not  offer  the  feature 

2—  Yes,  the  package  offers  the  feature  but  with  severe  limitations 

3  —  Yes,  the  package  offers  the  feature  with  moderate  limitations 

4  —  Yes,  the  package  offers  the  feature  with  minor  limitations 

5  —  Yes,  the  package  offers  the  feature  without  limitations 


Please  make  any  additional  comments  in  the  space  provided  on  the  checklist.  If  there  is  not 
enough  room  for  your  comments,  please  use  the  reverse  side  of  the  checklist  or  attach  a  separate  sheet 
of  paper  with  the  comments.  Make  clear  reference  to  the  function  and  feature  you  are  commenting  on 
by  using  the  same  numbering  system  or  title  used  on  the  checklist. 

As  you  perform  your  evaluations,  pay  particular  attention  to  the  features  marked  with  an 
in  the  left-hand  margin.  These  features  are  considered  critical  to  the  implementation  of  the  system 
and  deserve  special  attention  during  benchmarking. 

Additional  copies  of  this  appendix  may  be  reproduced  locally  or  may  be  obtained  from  the 
Logistics  Management  Institute,  Attention;  DL503  Project  Leader,  6400  Goldsboro  Road,  Bethesda, 
MD  20817-5886.  Completed  checklists  should  be  mailed  to  this  address  also. 
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